It's a shortened version of the phrase "getting on your nerves," which is still understood.
Getting nervous
